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Abstract 



We study on-line strategies for solving problems with hybrid algorithms. There is a problem 
Q and w basic algorithms for solving Q. For some A < w, we have a computer with A disjoint 
\Q \ memory areas, each of which can be used to run a basic algorithm and store its intermediate 

results. In the worst case, only one basic algorithm can solve Q in finite time, and all the 
other basic algorithms run forever without solving Q. To solve Q with a hybrid algorithm 
constructed from the basic algorithms, we run a basic algorithm for some time, then switch to 
another, and continue this process until Q is solved. The goal is to solve Q in the least amount 
of time. Using competitive ratios to measure the efficiency of a hybrid algorithm, we construct 
Zj ', an optimal deterministic hybrid algorithm and an efficient randomized hybrid algorithm. This 

resolves an open question on searching with multiple robots posed by Baeza- Yates, Culberson 
and Rawlins. We also prove that our randomized algorithm is optimal for A = 1, settling a 
conjecture of Kao, Reif and Tate. 

O 

1 Introduction 

o 

We study on-line strategies for solving problems with hybrid algorithms. There is a problem Q and 
w basic algorithms for solving Q. For some A < w, we have a computer with A disjoint memory 
areas, each of which can be used to run a basic algorithm and store its intermediate results. In the 
worst case, only one basic algorithm can solve Q in finite time, and all the other basic algorithms run 
^ ■ forever without solving Q. To solve Q with a hybrid algorithm constructed from the basic algorithms, 
we run a basic algorithm for some time, then switch to another, and continue this process until Q 
is solved. The goal is to solve Q in the least amount of time. 

This optimization problem can be conveniently formulated as one of exploring an unknown 
environment with multiple robots |], ||, |], [|, [7], [TlJ . At an origin, there are w paths leading off into 
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unknown territories. On one of the paths, there is a goal at an unknown distance n from the origin, 
and none of the other paths has a goal. Initially, there are A robots standing at the origin. The 
robots can move back and forth on the paths to search for the goal. The objective is to minimize 
the total distance traveled by all the robots before the goal is found. 

We use the notion of a competitive ratio, introduced by Sleator and Tarjan [Jl3| , to measure the 
efficiency of an exploration algorithm A. Let cost (^4) be the (worst-case or expected) total distance 
traveled by all the robots using A. Given a constant c, we say that A has a competitive ratio c if 
cost (.4.) < c-n + o{n). 

An extreme case where there is only one robot, i.e., A = 1, was studied by many researchers. In 
particular, Baeza- Yates, Culberson and Rawlins pf presented an optimal deterministic algorithm. 
Kao, Reif and Tate || reported a randomized algorithm, proved its optimality for w = 2, and 
conjectured its optimality for all w > 2. In these two algorithms, the single robot searches the w 
paths in a cyclic fashion, and the returning positions on the paths form a geometric sequence. (A 
returning position on a path refers to a point where the robot starts moving towards the origin after 
advancing away from it.) 

Another extreme case where the number of robots equals the number of paths, i.e., A = w, was 
studied by Azar, Broder and Manasse [0, who showed that the smallest competitive ratios are w 
for both deterministic and randomized algorithms. This ratio w can be achieved by the simple 
algorithm in which each robot explores a single path and keeps moving forward until the goal is 
found. 

The general case 1 < A < w has not been well understood, and its difficulty is twofold. Since 
A > 1, an exploration algorithm must coordinate its robots in order to achieve optimality. Moreover, 
since A < w, some robots must move back and forth on two or more paths, and their returning 
positions on those paths are crucial for optimality. Our main results are that for all values of A and 
w, we construct 

• a deterministic algorithm with the smallest possible competitive ratio, and 

• an efficient randomized algorithm that is provably optimal for A = 1. 

Our deterministic algorithm resolves an open question of Baeza- Yates et al. @ on exploration using 
multiple robots. The optimality proof for our randomized algorithm with A = 1 settles the conjecture 
of Kao et al. || in the affirmative. Our results also imply that randomization can help reduce the 
competitive ratios if and only if A < w. 

We discuss our deterministic exploration algorithm in §0 and the randomized algorithm in 
The paper concludes with some directions for future research in 

Throughout the paper, we label the w paths by 0, 1, . . . , w — 1 and the A robots by 1, 2, ... A. 



2 An optimal deterministic exploration algorithm 

Let D(w, A) denote the smallest competitive ratio for all deterministic exploration algorithms. The 
main result of this section is the next theorem. 

Theorem 2.1 D{w, A) = A + 
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Baeza- Yates et al. studied the case A = 1, and their results can be restated as 



D(w,l) = 1 + 2- 



1) 



(1) 



Theorem |2.1j generalizes ([!]) and answers the open question in || on optimal exploration using 
multiple robots. To prove Theorem 2A , we describe our deterministic algorithm in § [2.1| and give a 
lower bound proof in §ET2 



2.1 A deterministic exploration algorithm 

We first review the exploration algorithm for A = 1 given by Baeza- Yates et al. @ . This algorithm, 
referred to as T>(w, 1), is used as a subroutine in our algorithm for general A. Let 



f{w,i) 



for i > 0, 



w 
w—l y 

for % < 0. 



In algorithm V(w,l), the single robot searches the w paths in a fixed cyclic order. The search 
proceeds in stages, starting from stage 0. In stage i, the robot searches path i mod w until position 
f(w,i) and moves back to the origin if the goal is not found by then. If the goal is at position f(w,i) + 
1, then the robot finds it in stage i + w, traveling a total distance of f(w, i) + 1 + 2YJJt ~ 1 f(w,j). 
Baeza- Yates et al. showed that the smallest competitive ratio of T>(w, 1) is 

hm^oo < 1 + 2- -— j. 2 

In our algorithm for general A, for each k < A, the k-th robot only searches path k. These A — 1 
robots simply advance on their own paths and never move towards the origin. Let w' = w — A + 1. 
The A-th robot explores the remaining w' paths using T>(w', 1). The algorithm proceeds in rounds 
until the goal is found. In the i-th round, the robots move as follows: 

• The A-th robot chooses some path p according to T>(w', 1) and searches it from the origin to 
position /(«/, i — w'). 

• All the robots then move in parallel from position f(w', i — w') to position f(w', i + 1 — w') on 
the paths where they stand. 

• The A-th robot continues to search path p from position f(w', i + 1 — w') to position f(w', i) 
and then moves back to the origin. 

We next analyze the above algorithm. If the goal is at position f(w',i — w') + 1 on some path, 
it is found in round i. By the time the goal is found, the first A — 1 robots have each traveled a 
distance of f(w',i — w') + 1, and the A-th robot a distance of f(w',i — w') + 1 + 2 Z)}=o f( w> > j)- 
Hence, the smallest competitive ratio of the above exploration algorithm is 



lim,_ 



M/Ki-«/) + i) + 2E}^/Kj) 

f{w', i -w') + 1 
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By (fj), the above formula is upper bounded by 



A + 2- 



w 



iw' - 1 



A + 2 



>-A + l) 



(u-A+l 



(to -A) 



w-X ' 



which equals the competitive ratio stated in Theorem 2.1. 



2.2 A matching lower bound 

Here, we prove that our deterministic algorithm in §^T| is optimal by deriving a matching lower 
bound on the smallest competitive ratio r^ of any arbitrary deterministic exploration algorithm 
A(w, A) with w paths and A robots. Let to to be the time when A(w, A) commences. For % > 0, 
ti denotes the i-th time when a robot of A(w, A) starts moving towards the origin on some path. 
A(w, A) can be partitioned into phases where phase i starts at and ends at t,. The notion of a 



phase differs from that of a round in §2.1 



Lemma 2.2 Given A(w, X), there is a deterministic exploration algorithm A' (w, A) such that r^ < 
r_4 and A' (w, A) satisfies the following three properties: 

• No two robots search the same path in the same phase. 

• No robot moves towards the origin if some robot stays at the origin. 

• As soon as a robot starts moving towards the origin on some path, all the other robots stop 
moving until that robot moves back to the origin and then advances on another path to a 
previously unsearched location. 

Proof. Straightforward. □ 

If A = 1, i.e., there is only one robot, then A(w, 1) can be characterized by a sequence {(hi, ai),i > 1} 
where is the index of the path where the robot starts moving towards the origin in phase i, and 
hi is the distance that the robot searches on path in phase i. By simple calculation, the ratio r_4 
of A(w, 1) equals 

1 + 2-Iim-_ { hl + "^ hi '- 1 ) , (3) 

where i' is the smallest index such that i! > i and = c^. Motivated by this finding, for any given 
{(hi,cii),i > 1}, we define the corresponding ratio sequence {Hi,i > 1} by 

H, = + • £ (4) 

where i! is the smallest index with i' > i and = ai. Using ifj, ([|D can be written as 

1 + 2-lim^oo#i- 

A sequence {(/ij,aj),i > 1} is a w-sequence if hi > and a« is an integer for all i as well as 
\{i | Oi = j}\ = oo for at least w integers j. A w-sequence {(/ij,aj),i > 1} is a cyclic sequence if 
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di = i mod w. Since the integers a, are uniquely specified in a cyclic sequence, we represent a cyclic 
sequence by {s i; z > 1}. The corresponding ratio sequence, denoted by {Si,i > 1}, is thus defined 
by 

„ Si + ■ ■ ■ + Si +w -i 

Si = . (5) 



Fact 1 (see 0) For every cyclic w -sequence, linij„^ 00l S'j > ^ w ^w-i ■ 

Lemma 2.3 For each w-sequence {(hi,a,i),i > 1}, there exists a cyclic w-sequence {si,i > 1} such 
that lim^oo/Zj > lim^oo^. 

Proof. See Appendix [A|. □ 

Intuitively, Lemma [2.3| shows that we can modify a deterministic exploration algorithm to search 
the paths in a cyclic order without increasing its competitive ratio. 



Lemma 2.4 If A{w, A) has a finite competitive ratio and satisfies the properties of Lemma \2.2[ , then 
there exists a (w — A + l)-sequence {(hi, a^), i > 1} such that 

r A > X + 2-lim^ooi^, 

where {Hi,i > 1} is as defined in (|]). 

Proof. First, we inductively define the sequence {(hi,ai),i > 1} and a sequence of ^-dimensional 
vectors 7Tj = (7Tj(0), . . . , TTi(w — 1)). Then, we prove the inequality claimed in the lemma. 

We first define (hi,a\) and 7Ti by looking at the first phase of A(w,X). Assume that at time 
t\, a robot starts moving towards the origin on path j. Let hi be the distance that the robot has 
searched on path j. Define 

i\\ = (0, 1, 2, . . . , w — 1) and a\ = 

Once 7Tj_! is defined, we define (hi, aj) and 7Tj by looking at phase i of A(w, A). Recall that phase i 
starts at time and ends at time tj. Assume that path / is the unique path that is not searched in 
phase i — 1 but is searched in phase i. Also assume that at time t,, a robot starts moving towards the 
origin on path k. Let hi be the distance that the robot has searched on path k. For j = 0, . . . , w — 1, 
let 

f n-iil) if j = k, 
7Tj(i) = \ n-i(k) if j = I, 

{ n-iij) tfj^k and j 7^ I; 

i.e., we switch the k-th entry and the l-th entry of tt^x to obtain 7Tj. Let = iti(k). 

Since A(w, A) has a finite competitive ratio, {(hi,ai),i > 1} is an infinite sequence. For every 
i > 1, ti is the time when a robot starts moving towards the origin on some path p. Let i' > i be 
the index such that phase i! is the first phase that path p is searched again after U. Such exists 
and is finite. 
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Claim 2.1 For all % > 1, cij/ = dj and a,- 7^ /or j = i + 1, . . . ,i' — 1. 

To prove this claim, assume that = 71$ (A;), i.e., a robot starts moving towards the origin on path 
k immediately after t{. In phase i + 1, that robot moves back on path to the origin and then 
searches another path / with I 7^ k. Then, some robot starts moving towards the origin on path k\ 
with k\^k right after ti + \. Since k 7^ I and k 7^ k%, by the definition of 7^+1, 

7T i+ i(fc) = 7Ti(fc). 

By the choice of i', path must be idle from t i+1 to tj'-i- Hence, 

7Tj(k) = -Kj-i{k) = ■■■ = 7r i+1 (k) = 7Ti(k) = a t . (6) 

Moreover, aj 7^ iij{k). Thus, from (|), 

7^ cii for j = i + 1, . . . , i' — 1. (7) 

By the choice of i', path k is reused in phase i'. Assume that a robot searches path &2 immediately 
after ti'. By the inductive procedure for defining 7iv and <v, 

77^(^2) = 7Tj/_i(fc) and a v = ■K i '(k 2 ). (8) 

Combining ([]) and (|^), we have = ai. This and (0) conclude the proof of Claim [ZTT| . 

Claim 2.2 {(/ij, Oj), z > 1} zs a (to — A + l)-segwence. 

To prove this claim, the only nontrivial property of the sequence that we need to verify is that there 
are at least (w — X + 1) integers j such that \{i \ ai = j}\ = +00. By Claim |2TT| , it suffices to prove 



that there exist (w — A + 1) integers j such that 

ai = j for some i. (9) 
Without loss of generality, we label the w paths in such a way that 

• the label of the path where a robot starts moving towards the origin immediately after ti is 0; 

• paths 1, 2, . . . , w — A are not searched before ti, 

• i\ < i<i < ■ ■ ■ < i w -\ where ij is the first phase in which path j is searched. 
By the assumption on ao and the definition of a\, 

ai = 0. (10) 

For j — 1, . . . , w — A, let j* be the label of the path where a robot starts moving towards the origin 
immediately after ti.. By the definitions of {ni, i > 1} and {(hi,di),i > 1}, 7Tj.(j*) = Hi = 
■ ■ ■ = 7Tx(j) = j. Therefore, 

S = TTi, (j* ) = j for 1 < j < w - A. 
By this and (|TUD, at least w — A + 1 integers j satisfy (|9|), finishing the proof of Claim [272 . 
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Continuing the proof of Lemma |2]4], for each % > 1, let p be the path where a robot starts moving 
towards the origin right after ij. Let T be the first time when path p is searched for exactly distance 



hi in phase i' . By the properties stated in Lemma |2.2|, the A robots stand at different paths at time 
T. Let di, d,2, ■ ■ ■ , Oa-i be the distances that the robots except the one on path p are from the origin 
at time T. Let dj = minjdi, d 2 , . . . , g?a-i}- There are two cases. 

Case 1: dj > hi. If the goal is on path p at distance hi + 1, then when A(w, A) finds the goal, its 
performance ratio is at least 



di + d 2 + • • • + g?a_i 2 (hi + 



fri'-i) + K + 1 



> 



^ + 1 hi + 1 

2 (h X + • • - + 



A + 



hi 



(11) 



Case 2: dj < hi. Let p' be a path that has been searched up to distance dj at time T. If the goal 
is on path p' at distance dj + 1, then when ^4(to, A) finds the goal, its performance ratio is at least 



di + d 2 H h tZ,- + 1 + \-d X -i 2 (hi H h hi'-i) + hi 



dj + 1 

> dj + 1 f x 2jhi + ■ ■ ■ + h^_0 



^• + 1 



(12) 



Since ^4(w, A) has a finite competitive ratio, lim^oo hi = lim^oo dj = +oo. Therefore, by (|TT|) and 

(ED, 

2(h 1 + --- + hi/_i) N 



r.4 > lim^oo A + 



h; 



A + 2-limj^ooi/j. 



This and Claims |2.1| and p.2| conclude the proof of Lemma |2.4| □ 

Fact m and Lemmas |2.2| , |2.3| and give a lower bound proof for Theorem |2]1 



3 A randomized exploration algorithm 



We give our randomized exploration algorithm for general A in §3.1 and prove its optimality for 



A = 1 in 53.2 



3.1 A randomized exploration algorithm for general A 

We first review the randomized search algorithm of Kao et al. for A = 1, which we refer to as 
lZ(w, 1). Choose r w > 1 such that 



1) lnr^ 



mm 



r>i (r — 1 ) lnr 



Such r w exists and is unique |§. 1Z(w, 1) proceeds as follows: 

1. o^- a random permutation of {0, . . . , w — 1}; 

2. e^a random real number uniformly chosen from [0, 1); 
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5. repeat 

explore path cr (?) up to distance d; 
if goal not found then return to origin; 

i *— (i + l) mod w; 
until the goal is found. 

Let R(w, A) denote the smallest competitive ratio for randomized exploration algorithms for w paths 
and A robots. Let 

2 C - 1 
w (r w - 1) lnr^' 



Fact 2 (see §) /?(«;, 1) < R(w). 

We now construct our randomized exploration algorithm for general A using TZ(w, 1) as a subrou- 
tine. First, we pick a random permutation a of {0, 1, . . . , w — 1}. For the first A — 1 robots, robot i 
searches only path a (i) . These robots search their own paths at the same constant speed. The A-th 
robot searches the remaining w — A + 1 paths using 1Z{w — A + 1,1) also at a constant speed. The 
speeds are coordinated by a parameter v such that at any given time, the total distance traveled 
by the A-th robot is v times the distance traveled by each of the first A — 1 robots. By choosing an 
appropriate v, we can prove the next theorem. 



Theorem 3.1 R (w, A) < ± [{X - 1) + yj{w - A + 1) R(w - A + 1) 

Proof. The smallest competitive ratio of our exploration algorithm is at most 

A -!//x *n \ w-X + lfX-1 \ - . . _ 
A -l)+v) + + 1 R(w - A + 1 

W W \ V J 



At v = y(w — A + l) R(w — A + 1), this expression assumes its minimum 

-({X - 1) + J(w-X + 1) R(w-X+1) 
w \ v 



Combining Theorem 2.1 and 3.1, we can prove the following corollary. 



Corollary 3.2 If X < w, then the smallest competitive ratio of randomized exploration algorithms 
is always smaller than that of deterministic ones. 



S 



Proof. By Theorems |2.1| and |3.1| , we only need to prove 

sW-X+l 



-((X-l) + ^(w-X + l)R(w-X + l)) <A + 2 {w A + 
w \ J (w — X) 



Let a = R(w — A + 1), by Fact ^ which is a competitive ratio of a randomized exploration algorithm 
with one robot and w — X + 1 paths. Let 6 = 1 + 2 — > by Theorem |2.1| , which is the smallest 

competitive ratio of deterministic algorithms also for one robot and w — A + 1 paths. Since a < b 
M, to prove (|T3|), it is suffice to show that 



-((A-l) + A+l) a) <X-l + a, 



which is equivalent to (a — \fw — X + 1) > 0. □ 



3.2 A matching lower bound for A = 1 

The next theorem shows that our randomized algorithm is optimal for A = 1. 

Theorem 3.3 R(w,l) > R(w). 

The proof of this theorem uses a strengthened version of Fact § below. Let s = {si, i > 0} denote 
an infinite sequence of positive numbers. Let 

S w = {{si, i > 0}| lim Si = oo, so = 1, and for all i > 0, Si +W > Si}. 

i—*oo 

For any e > and s — {si, i > 0} G S w , let 

G w {e,s) = e}^ . 

An exploration algorithm with one robot is called cyclic if it searches the paths one after another 
in a cyclic order. 

Fact 3 (see 0) The smallest competitive ratio of any cyclic randomized exploration algorithm is at 
least 

2 

sup inf {1 H G w (e, s)}. 

e>0 ? 6Su, W 

Note that if w = 2, i.e., there are only two paths, then every exploration algorithm is cyclic. 
This is not true for w > 3. Ma and Yin || strengthened Fact |3| by removing the cyclic assumption 
about exploration algorithms. 

Fact 4 (see ||) The lower bound stated in Fact^ also holds for any arbitrary randomized exploration 
algorithms that may or may not be cyclic. 
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Proof. By Yao's formulation of von Neumann's minimax principle |14j], it suffice to lower bound 
the competitive ratios of all deterministic algorithms against a chosen probability distribution. The 
proof idea is to show that an optimal algorithm against the distribution used by Kao et al. || for 
Fact [3] can be modified to be cyclic. □ 

By Fact |], to prove Theorem |3.3| , we only need to prove the next theorem. Let 

r w _ 1 
£f w 

(r,„ — l")lnr„," 



Theorem 3.4 sup e>0 inf s - e5 „ G w (e, s) > C u 



The proof of Theorem TA is divided into three parts. In § 3.2.1 , we lower bound the infinite sum 
G w (e, s) by the finite sum 



H{k,s(e)) 



_l_ v^fc— 1 Sj(e)A \-Sj+ m -i(e) 

lns fc (e) 



In §3.2.2j , we lower bound this finite sum by C w . Finally in §3.2.3| , we complete the proof of 
Theorem |3~!4\ 



3.2.1 Lower bounding G w (e, s) by H(k,s(e)) 



Lemma 3.5 For all e > 0, there exists {sj(e), i > 0} G S w such that for all k with Sk(e) > 1, 

inf G w (e,s) > H(k,s(e)). 

Proof. By the definition of infimum, for all e > 0, there exists s(e) = {s,(e),i > 0} G S w such that 



inf G w (e, s) + e 2 

S&S W 

> G w (e,s(e)) 

= eE ^ )+ ;-;|,sr i(e) +(^(e))- 



i=k 



s fc (e) H h s k (e) 



l+e 



Since s'(e) = K(e) = i > 0} is in S w , 



k-l 



inf G w (e, s) + e 

s£S w 



Si(e) H h s i+t0 _i( £ 



= e E 

V i=o (si(e)) 

> ( e £ 

\ j=0 



l+e 



«i(e) H h Si +t0 _i(e)~ 



{Si{e)) 



l+e 



+ (^(e))- £ G M ,(e, S 1 ) 



(sjfc(e)) e inf G w (e, s). 
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Since sJe) > 1 and , e _. > -r— for all x > 1, 



inf G ffl (6,s) > — — 

s&s w 1 - (s fe (e)) 



> 



In sjfc(e) 



/ fc-i 
fe-i 

^ + E 

i=0 



Me) j h Sj + ^_i(e) 

(^(e)) 1+e 
Si(eJ H h s i+w _i(e)\ 



l+e 



□ 



Lemma 3.6 There exist a strictly increasing integer sequence {pi, i > 0} and a sequence s(e n ) such 
that 

lim H(k n , s(e n )) exists and is finite 



and 



sup inf G w (e,s) > lim H(k n ,s(e n )), 
w/iere e n = 4-, < p n < k n < p n + w - 1, and s kn (e n ) = max{s Pn (e n ) 



Proof. This lemma follows from the fact that by Fact |4] and Lemma |3.5| , H(k, s(e)) is bounded. □ 
3.2.2 Lower Bounding H(k, s(e)) by C w 



This is the most difficult part of the proof of Theorem |3.4| and requires six technical lemmas, namely 



Lemmas |3.7| through |3.12| . The proofs of these lemmas are given in Appendix 
We first rewrite 



h n 1 



H(k n ,s(e n )) 



In s k (e n ) 
1 

In s k (e n ) 



Si(e„) + 



i=0 

10— 1 k n — 1 

E E 



(*(en)) 



l+£n 



i=0 ( s «( e n)) 



Hence, by Lemma |3.6| , there is a constant C such that 

C>tf(A; n ,s(e n ))> Z 

where 

fcn-l 



(0) = £ 



In s fc (e n ) 
1 



(14) 



( S i( e n)) e 



and 



Ln(j) = E 



i=0 ( s i( e n)) 

for j = 1, . . . , w — 1. Note that Sk„ > 1 implies In s kn > 0. 

To further lower bound H(k n , s(e n )), we first work on L n (0) to show that Sk n {e n ) — > oo as n — > oo. 
Then, we work on L„(l) to show that s n (e n ) grows somewhat smoothly at a rate exponential in n. 
Finally, we lower bound all L n (j). 

The next lemma is frequently used in this section. 
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Lemma 3.7 For every positive integer m and for all e,x , . . . ,x m > 0, 



x 



l+e 1 l+e 

X 1 



X 



l+e 
m—1 



1 + 6 



.2 ; . 



V 



where E f (m) 



(l+e) m -l- 

The next two lemmas give some properties of the sequence {sfc n (e n ), k > 0}. 

Lemma 3.8 lim^^ s kn (e n ) = oo. 

For all n, pick h n e {& n — «; + 1, . . . , k n — 1} such that 

s hn (e n ) = min{s fcB _ 1J , +1 (e n ), . . . , s fcn _i(e n )}. 

Since p n — > oo as n — > oo, we assume without loss of generality that k n — w + 1 > 0. Since Sfc n (e n ) > 1, 
there exists a unique u n such that 

Sh n ^n) = {s kn {e n )f~ Vn . 
By the choice of k n and the monotonicity of S w , Sk n (e n ) > s/ in (e n ) and thus v n > 0. 

Lemma 3.9 lim^oo z/ n = and /or some finite A > 1, lim^oo (sfc n (e n )) ^ = A. 
The next lemma estimates L n (0) and L n (l). 



Lemma 3.10 lim^oo . Ln<yQ ) , > and lim 

n— >oo \ nSkn (e n ) — In A 



Ml) > _A_ 

»^ 00 lns kn (e„) — InA' 



The next two lemmas estimate L n (2) , . . . , L n (w — 1) . For all integers n > 0, let 6 n = e n + 
Clnsfc n (e„). In light of Lemma pTS] , we assume lnsfc n (e„) > 1 and thus 6„ > 1; otherwise we can 
replace {p n , n > 0} with a subsequence for which these bounds hold. 

Lemma 3.11 For all n > and i G {0, 1, ... ,w - I}, b^ -1 ^ 1 ^™" 1 > s 4 (e n ). 



Lemma 3.12 For j = 2, . . . ,w — 1 and « = 0, . . . , j — 1, lim^oo L n (j) > j^x-. 



3.2.3 Proof of Theorem 3.4 



From (|TJ) and Lemmas |3 . 1 0| and |3 . 1 2 , we have lim^oo H(k n , s(e n )) > 



of r^ and the fact A > 1 from Lemma 3.9, 



l+AH hA" 



A w -1 



InA ~~ (A-l)lnA 

Lemma |3.6|, we complete the proof of Theorem |3.4| and thus that of Theorem 1373 



( A - . By the definition 
> C w . Combining this with 
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4 Future research directions 



Our deterministic exploration algorithm is optimal for all A, but our randomized algorithm is only 
shown to be optimal for A = 1. For general A, it may be possible to obtain better or even optimal 
competitive ratios by holding A — 1 robots still while one robot moves towards the origin, as in our 
deterministic algorithm. This technique is not essential in our deterministic algorithm, but there is 
evidence that it may be useful in the randomized case. We further conjecture that there exists an 
optimal randomized algorithm in which one robot searches w — A + 1 paths and each of the other 
robots searches only one of the remaining paths. 

Our exploration algorithms minimize the total distance traveled by all the robots. It would be of 
interest to minimize the total parallel exploration time. We conjecture that the optimal competitive 
ratios of parallel time are achieved when the paths are partitioned as even as possible. 

In the layered graph traversal problem || [H], 1^|, one robot searches for a certain goal in a 
graph. The robot can shortcut between paths without going through the origin, and while exploring 
one path, it can obtain free information about the other paths. An analog of our work would be to 
study how to search a layered graph with multiple robots. 
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A Proof of Lemma |2t3 

The sequence {(/ij,aj),z > 1} characterizes a deterministic exploration algorithm A(w,l), and the 
smallest competitive ratio of this algorithm is 1 + 2-lim^ooifj. If A(w, 1) does not have a finite 
competitive ratio, then Lemma [2.3| holds trivially. Thus, we assume that A(w, 1) has a finite 
competitive ratio. 

Claim A.l lim^oo hi = oo. 

Proof. Assume for contradiction that the claim does not hold. Then there exist a constant M < oo 
and a subsequence {hi k ,k > 1} of {hi,i > 1} such that hi k < M for all k. Therefore, 



limj_»oo#i > lim fc _ >0O .fl r ij . 

hi H h/ij'-j 

lmifc^oo — 



K 

> — •lim fe _> 00 (/ii H 



which equals oo from the assumption that A(w, 1) has a finite competitive ratio. □ 

By Claim |A.1| , for any M < oo, \{h{ | hi < M}\ is finite. Hence, we can sort {hi,i > 1} into a 
sorted sequence {si,i > 1}. Observe that 

si + • • • + Si < hi + • • • + hi, for all % > 1. (15) 
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The sequence {sj,z > 1} is our desired cyclic ^-sequence, and its corresponding ratio sequence 
{S{, i > 1} is uniquely defined as in To prove Hindoo if j > lim i __ >00 S'j, it suffices to show that for 
each j large enough, there is a j* such that 

Sj < flj* and — > oo as j — > oo. (16) 

For any fixed j that is sufficiently large, we consider two cases. 

Case 1: There exists some t > j + w — 1 such that /it < Sj. Since t 7 > t is the smallest index 
with a t i = a t , f — 1 > t > j + w — 1. Hence, by (p~5|) , 



si + • • • + ft-i + • - • + hj +w _i h\ + • — h /it'-i „ , _s 

t), = < < : = ti t . 

sj Sj h t 

Let j* = t. Then, (fL6|) follows from ([17|) and the fact j* > j. 

Case 2: h t > Sj for all t > j + w — 1. Since {/ii, . . . , /ij+„,-2} contains all /i t with /i t < Sj, 
{hi, . . . , /ij +u ,-2} contains {si, . . . s^} as a subset. Thus, 

| ftt > and 1 < t < j + w - 2}| < (j + w - 2) - j = w - 2. (18) 

Since {(/ij,Oj),i > 1} is a w-sequence, there are w distinct integers V\, V2, ■ ■ ■ , v w , each appearing 
infinitely many times in {ai,i > 1}. Since j is sufficiently large, we can assume without loss of 
generality that each Vk appears at least once in {a±, . . . , aj}. For k with 1 < k < w, let j(k) < j+w—2 
be the largest index with a^k) — v k- Among • • • , fyj(™)> by (pT8|), at least two, say, ^(a^) and 
hj(k 2 ), are l ess than Sj. By the choices of j (ki) and j (A; 2 ), both f (A4) and / (k 2 ) are at least j+w — 1. 
Without loss of generality, we assume f (ki) > j + w — 1. By (0), 

S, = gl + - - - + Si+W ~ 1 (19) 



hi H h hj +w _i hi + h hju kl \_i 

<- <«. = _n. 



j(fci)- 



Now, let = j (A4). Since 1^ appears infinitely many times in {aj,i > 1}, j (ki) — > 00 as j — > 00. 
Now, ([16]) follows from (0). 

Cases 1 and 2 together complete the proof of Lemma 1273 . 



B Proofs of Lemmas |Sr7| through |3.12 
B.l Proof of Lemma |3.7| 



Xl 1 X2 I I X m 
TTt 1 TT7 "T - " " H 



> £^ + ^^ + ... + ^-gs- (because 1 + e > 1) 

j \ E c (m) 

> „ 7 , I 2122 (arithmetic mean > geometric mean) 




E e (m) 

> TTT^ I I • (because (1 + e) m > 1 + me) 
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B.2 Proof of Lemma 13.8 



By the choice of k n and the monotonicity of S w , we have Sk n (e n ) > Sj(e n ) for alii = 0, ... , fc n . Hence 



L n (Q) > 



(20) 



Then, the lemma follows from the facts that k n — > oo and e n — > as n — > oo and that by (0) and 



c> 



(sk n (e n )Y 



In s fen (e r , 



B.3 Proof of Lemma 13.9 



First, we have 



r /i \ _ S i+l( e n) . ST^ S i+l( e n) 



j=0 ( s i( e n)) + " j=h n ( s i( e n)) + " 

Noticing So(e n ) — 1 and applying Lemma |3.7| to the above two summations, we have 

L n (l)>L' n (l) + L' n (l), 

where 



L' n (l) 



(l + e r 



and 



/ i \k n -hn\ E tn (k n — hn) 

k n -h n I (s kn (en)r~ } 



(l + er 



Now, we can rewrite L' n (l) as 



where 



We also rewrite L' n (l) as 



where 



(l + e r 



fen h n 



> h —h 



1 + e r 



(1 + e n ) 



l + v n ) E en (kn - h n ) . 



& = (l-i/„) ( r ^) /l "^„(^). 
By Lemma O] and the fact that by ([TJ|) and (|2T| ) 

-e n + ^(l)+L^(l) 



C > 



In Sfc„(er 
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(21) 



(22) 



we conclude that for some constant c, 



< : — ^M-r < c and < - — ^V-r < c for all n. 



In s fc „(e n ) 



msfc n (e„) 



(23) 



Since 1 < k n — h n < w — 1 and u n > 0, no subsequence of {fl'^n > 0} can approach — oo or 
converge to a finite negative number. On the other hand, by Lemma |3.8| and (|23|), no subsequence 
of {/?", n > 0} can approach +oo or converge to a finite positive number. Thus, lim^oo = and 
consequently, linv^ v n = 0. By (||), 



L'Jl) 



hn 



1 \ kn(3' n 



ln Sfcn (e n ) (l + e n ) h - In ( Sfcn (e n ))' 



Since !<£;„ — h n < w — 1 and < fc n 7= < w — 1 



lim 



fen 



:i + e r 



1, lim A; n /3' = 1, and thus lim 



l n Sfcn (e„) 



lim J^M^ 



Using Lemma |3.S| , fl2"3|) and an argument similar to the proof for lim 
for some constant A 

lim (s fcn (e n ))^ = A > 1. 



n—roo "n 



0, we can show that 



B.4 Proof of Lemma fITTUj 

This lemma follows from Lemma |3ll and the fact that 1 < k, n 



h„ < w — 1 and < k„ h= < w — 1 



The calculations are similar to those for proving Lemma 3.9. 



B.5 Proof of Lemma |3.11| 

Since b n > 1, it suffices to show that for all i, 

where di = Yh~=o (1 + e nY • We can prove this inequality by induction on i. The base case follows 
from the fact that So(e n ) — 1 and b n > 1. The induction step follows from the fact that by Fact ^ 



and Lemma 3.5 



C> 



1 s i+1 (e„) 

In s kn (e n ) 



B.6 Proof of Lemma ffTTCl 



Ln(j) 



E 

u=0 



E 



Si 



0<i<k n -j 

\i=u (mod j) 
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where 



and 



3-1 /9(j»-i / \ 

_ J y gu+(t'+l)j^n j 

m=0 \ i'=0 ( S «+i'j( e n)) 
3-1 

u=0 



g{j, u) 



;i + er 



y,u) \ E €n {g{j,u)) 



b). 



(w-l)(l+e„)* 



The term I4(j, it) is obtained by applying Lemma 3/7 to the inner summation in the right-hand side 
of the above equalities. The derivation also uses the fact that because k n — w + 1 < u+g(j, u)j < k n , 



and the fact that by Lemma 3.11 



On the other hand, for each j = 2, 



e- 1)(1+e " r " > s u {e n ). 
. , w — 1 and u — 0, . . . , j — 1, 

lim - A ' 

In s k (e n 



jlnA' 

which can be verified using Lemma |3.9|, the fact 1 < k n — h n < w — 1 and < fc n 



and calculations similar to those in the proof of Lemma 3.9. 
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